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In the Claims: 

Please amend the claims as follows: 

1. (Currently Amended) Method for performing event detection and object tracking 
in an image streams, wherein an event is defined as the occurrence of a type of 
activity which requires some type of action in response thereto, said method 
comprising: 



a) installing in field, an s e t of image acquisition device for acquiring an image 
stream and s, each of wh i ch comprising a local programmable processor 
for converting the acquired image stream, consisting of one or more 
images, to a digital format, and a local encoder, for generating, from said 
image stream, non-image feature data A said non-image featuresy data 
including b ei ng parameters related to attributes of areas in said image 
stream, and for transmitting a non-image feature stream containing said 
features; 



b) connecting said eaeh image acquisition device to a data network through 
a corresponding data communication channel; 



c) connecting an image processing server to said data network; 



d} pr i or to d e t e ct i ng sa i d e v e nt, transm i tt i ng sa i d f e atur e str e am from sa i d 

i mag e acqu i s i t i on d e v i c e s to said imag e proc e ss i ng s e rv e r wh e n e v e r at 
le ast on e of a numb e r and typ e of sa i d f e atur e s e xc ee d a pr e d e t e rm i n e d 
thr e sho l d; 



e) whoro i n sa i d thresho l d i s app li ed to sa i d i mago acqu i s i t i on dov i co to 

contro l wh e n sa i d l oca l e ncod e r g e n e rat e s and transm i ts sa i d f e atur e 
str e am, and sa i d numb e r and type of f e atur e s e xc ee d i ng sa i d thr e sho l d 
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ar e i nd i cat i v e of act i v i ty to b e furth e r ana l yz e d by sa i d i mag e proc e ss i ng 
s e rv e r i n ord e r to d e t e ct sa i d e v e nt; 

f) d e t e rm i n i ng sa i d thr e sho l d by sa i d i mag e proc e ss i ng s e rv e r; 

g) detecting said event from analyzing said non-image feature stream by said 
image processing server and; 

h) transmitting, by said image processing server, indications regarding said 
event in said image streams to an operator. 

2. (Currently Amended) Method according to claim 1 , wherein the local encoder is a 
composite encoder, being the local encoder that further comprises circuitry for 
compressing the image stream, and further comprising: 

a) operating said composite encoder in a first mode, during which it 
generates and transmits said non-image feature stream to said image processing 
server, and 

b) operating said composite encoder in a second mode responsive to 
detecting said events, during which it transmits to said image processing server, in 
addition to said non-image feature stream, at least a portion of said image stream in a 
desired compression level, according to commands sent from said image processing 
server. 

3. (Cancelled) 

4. (Original) Method according to claim 1 , further comprising decoding one or 
more compressed image streams containing events by said server, and transmitting the 
decoded image streams to the display of an operator, for viewing. 
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5. (Previously Presented) Method according to claim 2, further comprising 
recording one or more compressed image streams obtained while said local encoder 
operates in said second mode. 

6. (Original) Method according to claim 2, further comprising dynamically 
allocating additional image processing resources, in the server, to data communication 
channels that receive image streams. 

7. (Cancelled) M e thod accord i ng to claim 2, wh e r ei n on e or mor e f e atur e str e ams 
transm i tt e d by sa i d l oca l e ncod e r op e rating i n th e f i rst mod e , compr i s e s on l y a port i on of 
th e i mag e str e am. 

8. (Currently Amended) Method according to claim 6, further comprising 
generating and displaying a graphical polygon that encompasses an object of interest, 
being within at least one of a tbe frame of an image and of an area of interest A04 in 
said image. 

9. (Currently Amended) Method according to claim 8, further comprising 
generating and displaying a graphical trace indicating the history of movement of an 
object of interest, being within at least one of the frame of an image and ef an area of 
interest A04 in said image. 

1 0. (Currently Amended) Method according to claim 1 , wherein the image 
stream is selected from a the group of images that comprises video streams, still 
images, computer generated images, and pre-recorded digital video data and or- analog 
video data. 

1 1 . (Original) Method according to claim 1 , wherein the image streams are video 
streams, compressed using MPEG format. 
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12. (Cancelled) M e thod according to c l a i m 2, wh e re i n dur i ng e ach mod e , th e 
e ncod e r us e s d i ff e r e nt r e so l ut i on and fram e rat e . 

1 3. (Currently Amended) Method according to claim 1 , wherein the non-image 
features data includes are at least one of: 

a motion features; 

foreground feature 

a color_feature: T 

port i on of th e i mag e ; 

edge data ; and 

frequency related information. 

14. (Currently Amended) Method according to claim 1 , further comprising 
performing, by the server, at least one of: 

License Plate Recognition (LPR); 

Facial Recognition (FR); 

detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection, 

using the non-image a feature stream T received from the l oca l encoder of at l east 
em image acquisition device, through the its data communication channel. 

1 5. (Currently Amended) System for performing event detection and object tracking 
in image streams, wherein an event is defined as the occurrence of a type of activity 
which requires some type of action in response thereto, said system comprising: 

a) an s e t of image acquisition devices, installed in field, e ach of wh i ch 
comprisinges: 
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a. 1 ) a local programmable processor for converting the acquired image 
stream to a digital format; 

a. 2) a local encoder, for generating, from said image stream, non-image 
features data , said non-image feature data including be i ng 
parameters related to attributes of areas in said image stream, and 
for transmitting a feature stream containing said non-image feature 
data , wh e n e v e r at le ast on e of a numb e r and typ e of sa i d f e atur e s 
e xc ee d a pr e d e t e rm i n e d thr e sho l d, wh e r ei n sa i d thr e sho l d i s 
app lie d to sa i d i mag e acquis i t i on d e v i c e to contro l wh e n sa i d 
e ncod e r g e n e rat e s and transm i ts sa i d f e atur e str e am, and sa i d 
numb e r and typ e of f e atures e xc ee d i ng sa i d thr e sho l d ar e 
i nd i cat i vo of act i v i ty to bo further ana l yzed i n ordor to dotoct sa i d 

b) a data network, to which the eaeb image acquisition device is connected 
through a corresponding data communication channel; 

c) a remote image processing server connected to said data network, said 
remote image processing server d e t e rm i n i ng sa i d thr e sho l d wh i ch i s 
app lie d to sa i d i mag e acquis i tion d e v i c e , and sa i d r e mot e i mag e 
processor receiving said feature stream transmitted by said local encoder; 
and 

d) said remote image processing server detecting said event from analyzing 
said feature stream, and transmitting indications regarding said event to 
an operator. 
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16. (Currently Amended) System according to claim 15, wherein said local encoder 
is a composite encoder and further comprises circuitry for compressing said image 
stream, said composite encoder having a first operating mode, during which it 
generates and transmits said feature stream to said remote image processing server, 
and having a second operating mode, during which said composite encoder it transmits 
to said remote image processing server, in addition to said feature stream, at least a 
portion of said image stream in a desired compression level, according to commands 
sent from said remote image processing server. 

17. (Currently Amended) System according to claim 16§, further comprising the 
remote image processing server decoding said portion of said image stream and 
determining said portion of said image stream contains an event; and 

an operator display, for receiving said portion of said one or more image steams^ 
containing the event from that aro docodod by the remote image processing server and 
conta i n e v e nts . 

18. (Currently Amended) System according to claim 16, further comprising a 
network video recorder for recording one or more image streams T obtained while said 
composite an assoc i atod l oca l encoder operates in said second mode. 

19. (Currently Amended) System according to claim 16§, in which the remote 
image processing server is capable of dynamically allocating add i t i ona l image 
processing resources to said data communication channels when said data 
communication channel that receive s said portion of said image streams. 

20. (Currently Amended) System according to claim 16, in which said portion of 
said on e or mor e image streams obtained while operating in the second fifst mode, 
comprises only a portion of the image that corresponds to a desired area of interest 

/\Q | 
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21 . (Currently Amended) System according to claim 165, in which the remote 
image processing server further comprises processing means for generating and 
displaying a graphical polygon that encompasses an object of interest, being within at 
least one of a the frame of an image and of an area of interest AQ4 in said image when 
said composite encoder is in said second operating mode . 

22. (Currently Amended) System according to claim 21 , in which the remote 
image processing server further comprises processing means for generating and 
displaying a graphical trace indicating the history of movement of an object of interest, 
being within at least one of the frame of said an image and ef the an area of interest of 
AO I i n said image. 

23. (Original) System according to claim 15, in which the image stream is 
selected from the group of images that comprises video streams, still images, computer 
generated images, and pre-recorded digital or analog video data. 

24. (Currently Amended) System according to claim 15, in which the image 
stream s ar e is a video streamsr compressed using MPEG format. 

25. (Cancelled) Syst e m accord i ng to claim 16, i n wh i ch dur i ng e ach mod e , th e 
e ncod e r us e s d i ff e r e nt r e so l ut i on and fram e rat e . 

26. (Currently Amended) System according to claim 15, in which the features 
afe stream includes at least one of: 

a motion features; 
a color_feature: T 
port i on of th e i mag e ; 
edge data; and 

frequency related information. 
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27. (Currently Amended) System according to claim 15, in which the remote 
image processing server further comprises processing means for performing at least 
one of: 

License Plate Recognition (LPR); 

Facial Recognition (FR); 

detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection; and- 

using the a feature stream T received from the local encoder of the at le ast on e 
image acquisition device, through the 4s data communication channel. 

28. (Canceled) 

29. (Canceled) 

30. (Currently Amended) Method according to claim 1 wherein said non-image 
featuresy data further comprises a motion featuresr and said motion feature s ar e is 
encoded in said feature stream only when said motion features exceeds a said 
predetermined threshold. 

31 . (Currently Amended) System according to claim 15 wherein said non-image 
featuresy data further comprises a motion featuresr and said motion features-afe is 
encoded in said feature stream only when said motion features exceeds a said 
predetermined threshold. 

32. (Currently Amended) A distributed image processing method for effectively 
performing event detection in a large number of concurrent image sequences, wherein 
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an event is defined as the occurrence of a type of activity which requires some type of 
action in response thereto, said method comprising: 

a) performing low level feature extraction in the vicinity of an image 
acquisition device, said low level feature extraction comprising: 

i) receiving an image stream from each of a plurality of image 
acquisition devices installed in field; 

ii) extracting non-image features from said image stream from each of 
said plurality of image acquisition devices, said features being parameters related to 
attributes of areas in said image stream; 

iii) prior to detecting said event, generating a reduced bandwidth non- 
image feature stream for each said image stream, said reduced bandwidth non-image 
feature stream based upon said features; 

b) prior to detecting said event, transmitting said reduced bandwidth non- 
image feature stream for each of said plurality of image acquisition devices to a 
remote image processing server; and 

c) detecting events by performing high level image processing at said remote 
image processing server, said high level image processing comprising: 

i) receiving said reduced bandwidth non-image feature stream 
transmitted from each of said plurality of image acquisition devices, 

ii) analyzing each said reduced bandwidth non-image feature stream 
at said remote image processing server, and 

iii) detecting events in each said image stream based upon said 
analyzing of each said reduced bandwidth non-image feature stream by 
said remote image processing server. 
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33. (Currently Amended) The method of claim 32 further comprising transmitting to 
said remote image processing server at least a portion of an image stream from any of 
said plurality of image acquisition devices associated with a reduced bandwidth non- 
image feature stream in which said remote image processing server detects an event. 

34. (Previously Presented) The method of claim 33 further comprising displaying 
said image stream in which an event is indicated on a display screen of an operator at 
said remote image processing server. 

35. (Currently Amended) The method of claim 32 wherein said features are encoded 
in said reduced bandwidth non-image feature stream only when at least one of a 
number and type of said features exceed a predetermined threshold, wherein said 
threshold is applied to said image acquisition device to control when said encoder 
generates and transmits said feature stream, and said number and type of features 
exceeding said threshold are indicative of activity to be further analyzed by said remote 
image processing server in order to detect said event. 

36. (Currently Amended) The method of claim 35 wherein said transmitting said 
reduced bandwidth non-image feature stream to said remote image processing server 
occurs only when said number and type of features exceed said predetermined 
threshold. 

37. (Currently Amended) The method of claim 35 wherein said features further 
comprise motion features, and said motion features are encoded in said reduced 
bandwidth non-image feature stream only when said motion features exceed said 
predetermined threshold. 

38. (Previously Presented) The method of claim 35 wherein said predetermined 
threshold is set by said remote server. 
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39. (Previously Presented) The method of claim 32 further comprises recording said 
image stream when said event is detected therein. 

40. (Currently Amended) The method of claim 35 further comprising transmitting to 
said remote image processing server at least a portion of an image stream from any of 
said plurality of image acquisition devices associated with a reduced bandwidth non- 
image feature stream in which said remote image processing server detects an event 

Th e m e thod of c l a i m 33 wh e r ei n sa i d r e duc e d bandw i dth f e atur e str e am 
compr i s e s on l y a port i on of sa i d i mag e str e am . 

41 . (Currently Amended) The method of claim 3S 40 further comprising generating 
and displaying a graphical polygon that encompasses an object of interest within at 
least one of a the frame of said at least a portion of an image and of an area of interest 
AOI in said at least a portion of an image roducod bandw i dth foaturo stream . 

42. (Previously Presented) The method of claim 41 further comprising generating 
and displaying a graphical trace indicating the history of movement of said object of 
interest. 

43. (Currently Amended) The method of claim 32 wherein said image stream is 
selected from a the group of images comprising video streams, still images, computer 
generated images, pre-recorded digital video data and pre-recorded analog video data. 

44. (Currently Amended) The method of claim 32 wherein said non-image features 
comprise at least one of: 

a motion features; 
a color_feature: T 
port i on of th e i mag e ; 
edge data; and 

frequency related information. 
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45. (Currently Amended) The method of claim 32 wherein said second processing 
step further comprises performing, by said remote image processing server, at least one 
of: 

License Plate Recognition (LPR); 

Facial Recognition (FR); 

detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection; 

using said reduced bandwidth non-image feature stream received from at least 
one of said plurality of image acquisition devices. 

46. (Currently Amended) A distributed image processing system for effectively 
performing event detection in a large number of concurrent image sequences, said 
distributed image processing system having an in field component and a remote 
component, wherein an event is defined as the occurrence of a type of activity which 
requires some type of action in response thereto, said distributed image processing 
system comprising: 

a) a low level feature extraction component located in field, said low level 
feature extraction component comprising: 

a plurality of image acquisition devices installed in field, each producing an 
image stream; 

a processor and an encoder associated with each of said plurality of 
image acquisition devices; 

said processor converting said image stream to a digital format; 

said encoder extracting non-image features data from said image stream 
and generating a reduced bandwidth non-image feature stream therefrom, said non- 
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image features data including b ei ng parameters related to attributes of areas in said 
image stream; 

b) a remote high level image processing component comprising a remote 
image processing server; 

c) a data network with which said low level feature extraction component 
communicates with said remote image processing server, each of said plurality of image 
acquisition devices and associated encoders communicating with said data network 
through a corresponding data communication channel; 

d) wherein said encoder transmits said reduced bandwidth non-image 
feature stream to said remote image processing server prior to detection of said event; 

e) wherein said remote image processing server analyzes said reduced 
bandwidth non-image feature stream and thereby detects said events associated with 
said image stream from each of said plurality of image acquisition devices; and 

f) wherein, responsive to detecting said events, said remote image 
processing server causes at least a portion of said image stream associated with said 
events to be transmitted to said remote image processing server. 

47. (Currently Amended) The system of claim 46 wherein said encoder comprises a 
composite encoder which incorporates said processor, and further comprises circuitry 
for compressing said image stream, said composite encoder bem§ having a first 
operating mode during which said composite encoder it transmits said reduced 
bandwidth non-image feature stream to said remote image processing server, and a 
second operating mode during which said composite encoder tt transmits to said remote 
image processing server, in addition to said reduced bandwidth non-image feature 
stream, at least a portion of said image stream in a desired compression level, 
according to commands sent from said remote image processing server, said remote 
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image processing server controlling said composite encoder to operate in said second 
operating mode responsive to detecting said events. 

48. (Canceled) 

49. (Currently Amended) The system of claim 47 further comprising an operator 
display for receiving from said remote image processing server said image stream in 
which said m event is detected. 

50. (Currently Amended) The system of claim 46 wherein said features are encoded 
in said reduced bandwidth non-image feature stream only when at least one of a 
number and type of said features exceed a predetermined threshold, wherein said 
threshold is applied to said image acquisition device to control when said encoder 
generates and transmits said feature stream, and said number and type of features 
exceeding said threshold are indicative of activity to be further analyzed by said remote 
image processing server in order to detect said event. 

51 (Currently Amended) The method of claim 50 wherein said reduced bandwidth 
non-image feature stream is transmitted to said remote image processing server only 
when said number and type of features exceed said predetermined threshold. 

52. (Currently Amended) The system of claim 50 wherein said features further 
comprise motion features, and said motion features are encoded in said reduced 
bandwidth non-image feature stream only when said motion features exceed said 
predetermined threshold. 

53. (Previously Presented) The system of claim 50 wherein said predetermined 
threshold is established by said remote image processing server. 
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54. (Currently Amended) The system of claim 47 further comprising a network 
video recorder associated with each of said plurality of image acquisition devices for 
recording said image stream when said composite encoder operates in said second 
operating mode. 

55. (Previously Presented) The system of claim 47 wherein said remote image 
processing server dynamically allocates additional image processing resources to data 
communication channels receiving said image stream. 

56. (Cancelled) Th e syst e m of c l a i m 4 7 wh e r ei n sa i d f e atur e str e am compr i s e s on l y 
a port i on of sa i d i mag e str e am . 

57. (Currently Amended) The system of claim 49 wherein said remote image 
processing server further comprises a programmable processor for generating and 
displaying on said operator display a graphical polygon that encompasses an object of 
interest within at least one of a the frame of said at least a portion of an image and gf an 
area of interest AQt in said at least a portion of an image. 

58. (Previously Presented) The system of claim 57 wherein said remote image 
processing server generates and displays on said operator display a graphical trace 
indicating a history of movement of said object of interest. 

59. (Currently Amended) The system of claim 46 wherein said image stream is 
selected from a the group of images comprising video streams, still images, computer 
generated images, pre-recorded digital video data and pre-recorded analog video data. 
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60. (Currently Amended) The system of claim 46 wherein said non-image 
features comprise at least one of: 

a motion features; 
a color_feature: T 
a port i on of tho i mago; 
edge data; and 

frequency related information. 

61 . (Currently Amended) The system of claim 46 wherein said remote image 
processing server performs at least one of: 

License Plate Recognition (LPR); 

Facial Recognition (FR); 

detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection; 

using said reduced bandwidth non-image feature stream. 
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